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ABSTRACT 



In this paper approximate models are given to describe 
backlogs of demands at a service system confronted by finitely 
many users. An application is to a time-shared computer center. 
Various functionals of the number waiting are discussed using 
the approximation. 
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1 . Introduction . 

Many computation centers and other job-shop-like systems, e.g. 
repair shops, are characterized by time-dependent random demand, and 
by sometimes considerable work backlogs. Computation centers that 
service terminals also have the peculiarity that if all customers are 
currently waiting in queue for attention, or are receiving service in 
a round-robin fashion, then no further demands can take place. This 
feature is characteristic of many '’repairman" type problems, the latter 
being prototypes of numerous cyclic queueing situations; see Feller [4] 
for a classical treatment, and Gordon and Newell [6] for other develop- 
ments . 

In this paper several new approximate models are given for the 
computer center problem. The models explicitly confront the time- 
dependent demand problem, where the latter refers to daily demand if 
desired. The results are easy to understand and compute with; they 
apply most accurately when the number of system users is large, as will 



often be true. 
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2 . Assumptions . 

Let m terminals be connected to a main computer facility. At 
time t suppose that the rate of new demand from each terminal is 
A(t). Effectively we are assuming that during hour t the totaJ 
number of demands is a pure birth process (see Feller [4]), or approxi- 
mately Poisson for short time intervals (non-time-homogeneous) , provide d 
the terminals are occupied and their users are not awaiting computational 
return (service) from the facility. 

Assume that the rate of completion of active user interactions 
is a constant, y , so that if a number of users are awaiting or under- 
going computational attention at time t, the chance that one leaves 
is ydt to terms of order dt. This assumption is in keeping with a 
first-come, first-served discipline; more importantly, it conforms 
approximately to a round-robin discipline, in which each customer present 
receives a small quantum of computer time. 
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3 . Model Equations , 

The above assumptions imply that Q(t), the number of terminal 
users that await or undergo service at time t, is described by a 
birth and death stochastic process, see Feller [4]. One can envision — 
but not relish — the task of writing down m + 1 simultaneous differential 
equations for the probabilities that Q(t) = j (j = 0,1,..., in), working 
out a solution, and then interpreting the results. 

The solution must necessarily be numerical, and will be tedious 
and expensive to obtain if m grows large. We present here an approach 
that is approximate but should be quite accurate when m is moderately 
sizable, and business is brisk at the computer. The approach is based 
on approximating Q(t) by a deterministic part, plus an additional 
noise , the latter being characterized as a random process. In the 
present situation the noise turns out to be a familiar Gaussian diffusion 
process, the Orns tein-Uhlenbeck, see Cox and Miller [1]. It has proper- 
ties that may be exploited in order to shed light on the computer's 
service capabilities . 

If m, the number of terminals, is large then it is plausible 

that -> q(t) , a deterministic function. That the latter is true 

m 

for constant A(t), equal to A, follows from results of Iglehart, 
for the closely related repairman problems; see [7]. Next consider 

N (t) = alt) (3.1) 

m r— 

vm 

where the latter is the "noise" process for finite m. We shall study 
N^(t) as m -> 00 , and then approximate Q(t) by 



Q ( t) - mq ( t) + N(t) , 



(3.2) 
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N(t) being the limiting noise. Note that if m is made large our 
assumptions imply that demand rate, and hence queue size grow indefi- 
nitely. To obtain a sensible limit we must scale; my is now the 
departure or interaction completion , rate. 

Argue as follows concerning changes in Q(t) in a short time 
interval of length dt: Q(t) moves deterministically by an amount 

{ [iu-Q (t) ]A (t) -my }dt except when Q(t) = 0; furthermore, the variance 
of the displacement is simply { [m-Q (t) ] A (t)-i-my }dt 4- o(dt). Assuming 

that we wish to approximate by a diffusion, write the stochastic 
differential equation 



where dW(t) is the "differential" of a Wiener process (distributed 
like a normal random variable with mean zero and variance dt) . Doob 
[3] addresses the mathematical problems that arise; also Cox and Miller 
[1], Gikhman and Skorokhod [5], and McKean [8], 

Next apply the normalization (3.1). We have 



dQ ( t) = { [m-Q(t) ]A(t)-my}dt + /{ [m-Q(t) ]+my } dW(t) (3.3) 



dQ(t) = v / mdN^(t) + mdq(t) = 



{ [m(l-q(t) )-v / mN m (t) ]A(t)-my}dt 



+ /{ [m (1-q (t ) ) “V^mN m (t) ] A (t)+my } dW ( t ) (3.4) 



After division by m we obtain 



dN^(t) + v^n" dq ( t) = { [ ^(l-q ( t) ) - N m ( t ) ] X ( t) - Jm y}dt 




A (t) + y dW( t) (3.5) 
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Clearly if m -* » the above equation makes sense only if coefficients 
of /m cancel out; this leads to a differential equation for the deter- 
ministic part, q(t) : 

^ = X (t) [l-q(t) ] - y . (3.6) 

Taking m ® in the remaining equation yields the stochastic differ- 
ential equation 

dN(t) = -X(t)N(t) + /[ (l-q(t))X(t)+y] dW(t) . (3.7) 

The latter is recognized as describing a non-stationary Ornstein- 
Uhlenbeck diffusion process; see Cox and Miller [1], p. 225. We have 
neglected the boundary condition at zero (no queue can become negative) 
and hence our solution will be valid only when zero is seldom visited, 
i.e. when A(t) >> y , at least most of the time. But this is precisely 
the peak load problem that is often of interest to designers and users. 
Deterministic Component: Solution 

The equation (3.6) may be solved by routine methods. We find 

-/^A(s)ds r t -/ t A(s)ds 

q ( t) = q (0) e + [A(x)-y]e X dx (3.8) 

Jo 

In case A (x) < y the relevant portion of the integrand should, in the 
spirit of our approximation, be replaced by zero. 

Example: A(t) = A, a constant. 

In this case, for A > y 



q (t) = q (0) e Xt + (l - (1-e Xt ) 



(3.9) 



6 






and in the long run (t-*°°) 

q(t) = 1 " f (3.10) 

A little thought reveals the plausibility of this result. Our system is 
behaving like an infinite server system fed by a Poisson source, where 
the servers are now the terminals, and the computer is the source (of 
returned transactions) . The expected number residing at the terminals 
is approximately m the remainder waiting or being served at the 

A 

computer . 

Stochastic Component: Solution 

A formal solution of (3.7) is seen to be 

(s) ds rt -f l A(s)ds 

N(t) = N (0) e + e X a(x)dW(x) (3.11) 

Jo 



where 



a(t) = /[ (l-q(t))A(t)+y] (3.16) 

and the integral involving dW(*) may be interpreted by integration by 

-/qA ( s)ds 

parts. Apparently N(t) is normal or Gaussian with expectation N(0)e 
and, given N(0), we find 



-/b( s)ds 

E [ (N (t) -N (0) e U ) 2 ] 



ft -2 / A (s)ds 

e X a 2 (x)dx 

J 0 



(3.13) 



= Var [N(t) ] 
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Example: A(t) = X. 

In this case (3.13) becomes 



E[(N(t)-N(0)e At ) 2 ] = 



-2A (t-x) 



a 2 (x) dx . 



where 



a 2 (t) 



p (2-e At ) + [l-q(0)]Xe At 



thus 



E[(N(t)-N(0)e At ) 2 ] = X (1_e 2Xt) , 

= Var[N(t) ] . 



There is close agreement between the long-run (t->°°) moments of 
and of the approximation (3.2) when X >> p. 



(3.14) 

(3.15) 

(3.16) 
Q(t) , 
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4 . Applications of the Approximation . 

The mathematical results obtained may be useful in assessing 
various aspects of system performance. We briefly describe these, 
a) Distribution of Q(t), the number of terminal customers waiting. 

In our approximation, Q(t) is normally distributed such that 

E[Q(t) ] - mq(t) , (4.1) 



with q(t) given by (3.8), and Var[N(t)] given by substituting into 
(3.13). One should find such approximations useful for quick estimates 
of time-dependent behavior, and also for checks of simulation validity, 
b) Distribution of total waiting time. 

It may be of interest to describe the total accumulated waiting 
time of all applications for service during a fixed time period, e.g. 
one day ; 



Q(t) 



ft 

Q(r)dr 

h 



Our approximation amounts to writing 



Q(t) 



ft 

(mq(r) + v / mN(r)}dr 

J 0 



which immediately implies that Q(t) is approximately normally distrib- 
uted with parameters 



and, if N(0) = 0, 



E[Q(t) ] - m 



ft 

■*0 



q(r)dr 



Var [Q(t) ] 



m Var[ 



N(r)dr] 



(4.2) 



where the latter may be simplified by integration by parts. 
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Example: A(t) = A. 

Evaluation of (4.2) requires an expression for the variance of 
the integral of N(r). Integration by parts gives 



N(t) 



ft 

•*0 



N(r) dr 



ft 


ri-e' X(t_x) 1 


J 0 


A 



a(x) dW(x) 



(4.4) 



and thus 



Var[N(t) ] 



ft 


- 1 _ e -A(t-x)- 


•'0 


X 



a 2 (x)dx 



(4.6) 



If q(0) = N(0) = 0, then by (3.15) 



Var [N (t) ] = 



|-t ri _ e -X(t-x> 



0 L 



[2p+(A-y)e ]dx 



2d ^ 
A? C 



as t -> 



(4.7) 



Perhaps of more interest in the context of computer system applications, 
where interest focuses on t of the order of hours, and X ^ on a 
one-minute scale, the above is expressible as 



Var [N(t) ] ~|z t 



(4.8) 



as A 00 for fixed t. 
c) Probabilistic bounds on Q(t) . 

Although we have found in a) an approximate normal distribution 
for Q(t) at any fixed time t, it would be desirable to provide infor- 



mation on Q(t) for all t during a particular period. For example, 
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we would like to be able to state that, during a day, queue size ever 
exceeds some specified level only with a given (small) probability. 
Such statements can be made if we can derive a boundary, B(t) , such 
that 



P{Q(t) £ B(t) , all t <: T}. 



(4.9) 



is specified. 

In fact, such boundaries may be derived mathematically and we 
describe two of them. Unfortunately these are not entirely appealing 
from a practical viewpoint: either the boundary shape is unsatisfactory, 

or the probability associated with a boundary crossing is not expressed 
in a usable mathematical form. 

c-1) Transformation to Wiener process with linear boundary. 

Our first boundary problem is derived by expressing N(t), the 

noise process, as a Wiener process, and referring the latter to a linear 

boundary. Probabilities for crossing such boundaries are well known. 

Transform (3.7) into 

/h(s)ds /h(s) 

d[N(t)e ]=e U /[ (l-q( t) ) X ( t)+y J dW(t) , (4.10) 

/gA(s)ds 

from which it is clear that the process {N(t)e } is Wiener with 

2/^X(s)ds 

zero mean and infinitesimal variance equal to e [ (1-q ( t) ) X ( t)+p J . 

A time-scale transformation x(t) converts the Wiener process into one 
with stationary increments; necessarily 

2/h(s)ds 

dt = e [(l-q(t))A(t)+y]dt (4.11) 



or 
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T(t) 



•t 2/^A(s)ds 

e [ (l-q(r))A(r)+y]dr. 

J 0 



(4.12) 



Thus 



N(t)e 



/*" A(s)ds 



= V(x) , 



(4.13) 



a zero-drift Wiener process with unit infinitesimal variance and 
V(0) = N(0) = 0. It is known (see Cox and Miller, pp. 220-221) that 
if a > 0 



P(V(t) £ a + b , ¥t<;t} = <J> - e 

Sr 



$ being the standard normal distribution function. 
Thus with the above probability, (4.11), 



-2ab * f-a+bT 



♦ (4.14) 

/F 



N(t) £ {a + b 



t 2/QA(s)ds 



[ (1-q)) A (r)+y ]dr}e 



~/q A( s)ds 



(t) (4.15) 



for t,0 £ t £ T, and x(t) = t. From this result we can state 

that with (approximate) probability (4.14) 

Q ( t) £ mq(t) + 4" B(t). (4.16) 

Example. A(t) = X, a constant. 

Let q(0) = 0. Then 



8(t) = {a + b 



2Ar ro , /y \ -Ar , , -Xt 

e [2y+(A-y)e ]dr}e 



-Xt , - r/1 y N , y -Xt, n , 

= ae + b [ (1 - — ) + ^ e - e ] (4.17) 



and hence 
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Q(t) £ m[(l - yXl-e At )] + /m B(t) (4.18) 

for all t ^ T; 

x - j e 2Ar [2y+(A-y)e _Ar ]dr = ^-( e 2AT -l) + (1 - ^) ( e AT -l) (4.19) 

so for given T one solves for x required to evaluate (4.18). 
Unfortunately, the above boundary tends to be excessively U-shaped; in 
particular it is very high — and hence uninformative — for large T. 
c-2) Straight line boundary for stationary Ornstein-Uhlenbeck noise. 

Let us consider the special case of A ( t ) = A a constant. Then 
N(t) , the limiting noise, eventually becomes Ornstein-Uhlenbeck, satis- 
fying 

dN (t) = —AN ( t) dt + /2 X dW(t) (4.20) 

or 

dN ( t T ) = -AN( t 1 ) d t 1 + dW(t T ) (4.21) 

if t T = 2yt. The time to reach a boundary B(t) = c > 0 from x, 
denoted by T^ has a Laplace transform that may be expressed in terms 
of Weber, or parabolic cylinder, functions; according to Darling and 
Siegert [2] 

-sT D_ (x) 

E[e C | N (0) = x] = p - S - c y , (4.22) 

but the actual probability distribution of T^ is not given numerically 
in the paper cited, and I have not seen a numerical tabulation in the litera- 
ture. Actually, such a tabulation would be useful for one could then assess 
the probability distribution of max Q(t) over a one-day period. 
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5 . Concluding Remarks . 

The above model may be generalized in various directions, some 
of which are likely to be useful. 

a) Service rate, y, need not be a constant, but may be made a function 
of time. In particular, justification of the time-dependent results 

for arrival and service functions that are constant over t-intervals 
should be straightforward. A time-dependent service rate might be 
required to reflect the difference in business submitted (transaction 
type changes) throughout a day. Time dependent changes in m, the 
number of active terminals, may also be handled on a piecewise constant 
basis . 

b) Service need not be exponential-Markovian . If traffic is heavy and 
transactions require arbitrarily independently distributed random times 
S to terminate, then it is natural to substitute the renewal theoretic 
asymptotic variance into the stochastic differential equation (3.7): 

-3 

simply replace y by Var[S](E[S]) under the radical. 

Finally, it is of interest that a variety of different, but 
similar, stochastic models for cyclic service result in the same limiting 
"noise" process to be superimposed upon the deterministic solution. This 
sort of robustness encourages one to think that simple models of the type 
suggested will often work adequately to generate useful insights, and 
to supplement or replace more complex calculations or simulations. 
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